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[57] ABSTRACT 

A multiprocessor computer system includes a number of 
processors, each processor having an interrupt mechanism 
and connecting in common to a system bus over which 
interrupt requests are communicated When a processor 
accepts an interrupt request from another processor, it gen- 
erates an acknowledge response on the system bus. If such 
processor contains a previous and pending interrupt request 
of an equal or higher priority level, it generates a not 
acknowledge response on the system bus and refuses the 
interrupt request At the completion of servicing an interrupt 
request, each processor places on the system bus, an inter- 
rupt completed conomand including an address identifying 
such processor, a code designating a priority level to which 
it has switched and a code indicating that the processor has 
completing servicing an interrupt request. Each interrupt 
mechanism further includes interrupt retry means containing 
a refused interrupt register means for storing the channel 
address of the processor generating the not acknowledge in 
response and the priority level code contained in the inter- 
rupt request, and a level monitor logic unit connected to the 
system bus. The level monitor logic unit detects interrupt 
completed commands and compares the channel address and 
priority level code in the interrupt completed coimnand to 
channel address and level code stored in the refused inter- 
rupt register means. When the processor channel addresses 
match and the level code is less than the level stored in the 
refused interrupt register means, the monitor logic unit 
generates a retry interrupt output. The processor retries the 
corresponding previously refiased interrupt request upon 
receipt of the retry interrupt output. 

15 Claims, 4 Drawing Sheets 
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APPARATUS AND METHOD FOR 
PROVIDING MORE EFFECTIVE 
REITERATIONS OF INTERRUPT REQUESTS 
IN A MULTIPROCESSOR SYSTEM 

This application is a Continuation-ia-Part of patent appK- 
caticn Ser. No.. 07/78 1^24, filed on Oct. 22, 1991 U.S. Pat 
No. 5,404,535. 

REI^i^D APPLICATIONS 

The patent application entitled, **Apparatus for Marriage 
of Interrupt Mechanisms Between Different Types of Pro- 
cessors in a Single System" invented by James W. Keeley, 
Richard A. Leraay, Thomas S. Hirsch, John L. Curley and 
Biuno DiPlacido, Jr., Ser, No. 07/780,686, filed on Oct. 18, 
1991 which became abandoned on Sep. 30, 1994. 

BACKGROUND OF THE INVENTION 

1. Field of Use 

The present invention relates to the cooperative operation 
of multiple processors in a- single system and, more 
particularly, to a means for reducing the number of interrupt 
retry attempts between processors of a multiprocessor sys- 
tem. 

2. Prior Art 

A recurring problem in present computer systems arises 
from the need to combine the various processors of a 
multiprocessor system into a cooperative system, and in 
particular, the need to integrate communications between the 
processors of a multiprocessor systenx 

This problem frequently occurs in coordinating the op^a- 
tions of the interrupt mechanisms of the processors of the 
system- As is well known, "interrupts" are a primary means 
of communication between the elements of most computer 
systems, wherein one element of the system, such as a 
processor may send a request, referred to as an 'Intemipt**, 
to another element of the system, such as another processor, 
requesting that the other processor perform some operation 
for the requesting element or for notifying the other proces- 
sor of an event requiring attention. Interrupts are commonly 
assigned priority levels and, if the processor receiving the 
interrupt is executing an operation or servicing an interrupt 
of lower priority level than the Interrupt, the receiving 
processor will suspend, or interrupt, the current operation 
and perform flie action requested by the interrupt. 

If, however, the receiving processor is servicing an inter- 
rupt of the same or a high priority than the new interrupt 
request, the new request will be denied, commonly referred 
to as *'aot acknowledged*'. This requires that the requesting 
processor repeat the request for the interrupt at a later time, 
and generally continue to repeat the interrupt request until 
the request is accepted. This repetition of interrupt requests 
until acceptance, however, can consume substantial mounts 
of processor and system bus resources which are urgently 
needed for actual operations. 

This problem arises tK>th in a multiprocessor system using 
a single type of processor and, even more acutely, systems 
using different types of processor units to allow the system 
to perform a wider range of operations than may be achieved 
through a system using a single type of processor or to 
inaease the performance of the system by adding faster and 
more powerful processors or processors providing special 
capabilities. An example of one such system is disclosed in 
U.S. Pat. No. 5,283,870 to Thomas Joyce and James W. 
Keeley entitled, "Method and Apparatus for Avoiding Pro- 
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cesser Deadly Embrace in a Multiprocessor System" which 
issued on Feb. 1, 1994. 

It is also well known, and a further problem in interrupt 
communication between processors, that different types of 

3 processors frequently recognize and use different types, 
numbers and levels of intennpts, so that communications 
between, for example, a processor designed for a proprietary 
system such as a DPS 6000 and a processor such as the Intel 
80486, can be more di£Scult 

10 Additionally, in the above discussed multiprocessor 
systems, it is impcatant that each processor be able to 
communicate interrupt requests to other processors within 
the system in the most efficient manner. Generally, there are 
three basic reasons for a processor generating an interrupt 

15 One reason is that the processor is calling itself to change 
priority level to service a more important task. Another 
reason is that another processor is generating a "solicited" 
interrupt notifying die processor attempted to be interrupted 
of the completion of a previously requested task. The last 

20 reason is a processor generates an "unsolicited" interrupt 
request to notify another processor of the occurrence an 
important event Such an event could be the detection of a 
change in state of a mechanical device, environmental 
sensor or power fail device resulting in the generation of an 

25 unsolicited interrupt 

In these cases, it is most important that such interrupts be 
prioritized in order to ensure that they are processed in the 
most efficient manner. For example, unsolicited interrupt 
requests generally would be assigned the highest priorities 

30 so that they receive immediate attention. It can be seen that 
where a processor is generating an interrupt for calling itself, 
this operation may preclude the servicing of higher priority 
interrupts. Therefore, it is important to take into account the 
servicing of different types of interrupts within a multipro- 

35 cesser system which are assigned different priorities. 

It is therefore an object of the present invention to provide 
an efficient way of having the processors of a multiprocessor 
system respond to the different types of interrupt requests 
received from each other. 

SUMMARY OF THE INVENTION 

The present invention is directed to a multqirocessor 
system which has a plurality of processors, each processor 
having an interrupt mechanism and each processor being 

45 coimected in common to a system bus over which interrupt 
requests are communicated between processors. Each inter- 
rupt request includes a first channel number identifying the 
processor which is the source of the request, a second 
channel number identifying the processor which is the 

50 destination of the request, and a code identifying die level of 
the interrupt request 

When a first processor accepts an interrupt request from 
a second processor, the first processor via its interrupt 
generates an acknowledge response on the system bus. If the 

55 second processor contains a previous pending request or is 
processing an interrupt request of the same or higher priority 
level, the second processor generates a not acknowledge 
response on the system bus. At the completion of servicing 
an interrupt request, the second processor via its interrupt 

60 mechanism places an interrupt conopleted command on the 
system bus. The interrupt completed includes a channel 
address identifying the second processor, a code designating 
the priority level to which it has switched and a code 
indicating that the processor has completed servicing an 

65 interrupt request. 

Each interrupt mechanism further includes interrupt retry 
means which operatively couples to the system bus. The 
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mtemipt retry means includes a refused interrupt register Next described is the apparatus of the present invention 

means for storing the channel nimiber of a second processor for reducing the reiteration of intemipt requests from one 

and the priority level code contained in a refused interrupt processor to another processor when an Initial interrupt 

request in response to a not acknowledge response from request by the requesting processor has been refused by the 

such second. Also, the retry means includes a level monitor 5 recipient processor. As described herein, the aH>aratus of the 

logic unit which detects the occurrence of an intemipt P^^^nt invention may be used in connection with various 

completed command on the system bus and coiqjares the ^P^^ interrupt mechamsrns. 

channel address and priority level code contained in the M^ttprocessor System of FIG. 1 

inteiTuptcompIetedcommandtoasecondprocessorchannel u 1? 

address identilication and priority level code stored in the lo ,f ' P^"^*/ Centra^ Processing 

refused interrupt register means. When the channel address ^mts flirough Wx and peer Processors 12a and 12fc 

in the interrupt completed command corresponds to the ^^1'* aghtly couple in commcM to a System Bus 14 and to 

processor chainel address stored in the refused intemipt « Sy^*"^ »femory 16. Each Processor 10 and 12 

register and the priority level code in the interrupt completed shown, includes a Bus Interface 18 which enables the unit 

coWuind is less than the priority level code stored in the 15 to transmit or receive requests m the f«rm of commands, 

refused intemipt register means, the monitor logic unit "itetnipts. data or responses/status to anoth^umt on System 

generates a re^y intoupt output. Tlie first processor in ^ *f preferred embodiment System Bus 14 

response to such interrupt reti^ output retries the cone- °P?f « asynchronously and uses a spUt bus cycle protocol 

spending previously refused intemipt request by again PJ°^?«. peiformance by granting other umts 

^plying the interrupt request to the system bus. Since the 20 <»'^g P«!"°f °^ .'^^ ^ « "^^'^S 

iil^tTupT request is of a higher priority than that of the first f^T'u t .k"" '"P"^'-'' ? ^ f « 

processor, it will be most likely accepted. ^^^^7 4"^ ^ P^^fS^r*^ ^ 

. . . . ^ . System Bus 14 IS. for example, a MEGABUS* synchronous 

By only havmg a processor rrtty a previously refused ^us. For further information regarding this type of 

interrupt request when the level of the intcnupt request has ^us interface and operation, reference may be made to U.S. 

a pnonty which is higher than that of the processor ^ j^^^ ^ 

attempted to be intemipted, this eliminates having to retry •megabus is a ^mark of BuU hn mfonnaiion system inc. 

interrupt requests which are unlikely to be accepted This Referring to FIG. 1, it is seen that each peer Processor 12 

has aparticular advantage where a processormakes changes includes a Microprocessor 20, a Local Memory 22 and 

in its priority level by m a kin g calls to itself. In such cases. Interface Buses 24 which couple to Bus Interface circuits 18, 

a match of channel numbers will always occur but the added shown. Microprocessor 20 and Local Memory 22 are 

levelrcquiremcnt will operate to filter out interrupt requests tightly coupled through a Local Processor Bus 26 and 

which need not be retried. The present invention also operate under control of clock inputs provided by a Qock 

facilitates the efficient processing of high priority unsolicited Qrcuit (CLK) 28. Microprocessor 20 is a high performance 

interrupt requests in that processors can now give greater 32-bit processor which operates at dock speeds of up to 33 

attention to processing these requests. 35 j^jj^ ^ preferred embodiment corresponds to an 

The foregoing and other objects, feamres and advantages Intel 80486 chip, 
of the present invention wUl be apparent from the following The Intel 80486 chip includes a raiaoproccssor, a float- 
description of the invention and embodiments thereof, as ing-point math coprocessor, a memory cache controller and 
illustrated in the accompanying drawings. an 8K RAM cache unit The principal processing function is 

^ performed by the microprocessor while complex processing 

BRIEF DESCRIPTION OF THE DRAWINGS functions, such as floating operations, are performed by the 

^ . . , , J. f ,4.. . math coprocessor. The internal cache unit provides fast 

FIG. 1 IS a block diagram of a multiprocessor system ^ ^ processing. In the preferred 

which incorporates the concepts of the present invention. embodiment, peer pr^essors 12 operate mda the control of 

FIG. 2 is a block diagram of processor with logic used for 45 ^ unk** operating system. 

interfacing the interrupt mechanisms of the various proccs- **UNIX is a registered trademark in the United Slates aiKl other countries, 

SOrS of the system of FIG. 1. licensed exclusively through X/Open Company Limited. 

HG. 3 is a block diagram of a processor with logic foe ^ system of HG. 1, Central Processing Units 10 

coordinating interrupt operations between processors and, in function as host processors. In the preferred embodiment, 

particular, for determining when a processor may retry a each processor takes the form of a BuU DPS6000 system 

refused interrupt request. ^hi^h operates under the control of the Bull HVS propri- 

^ . *i J. J. t • • *u *• etary operating system. Each oftheprocessoTs are organized 

FIG. 4 is a flow diagram used m explaming the operation * 

^, * • ^- r & sr operate m an independent manner and have access to the 

of the present mvention. ^ , ^ ^ . < 

^ full con:^)lement of system resources, such as input/output 

DESCRIPnON OF PREFERRED memory and the like. 

EMBODIMENTS Processor 12-FIG. 2 

Shown in FIG. 2 is a block diagram of a Processor 12 with 

The following first describes a means for interfacing the the logic of the present invention for interfacing the interrupt 

interrupt mechanism of one type of processor such as a very mechanisms of Processors 12 with the intemipt mechanisms 

high performance processor to that of another type of 60 of Central Processing Units 10, System Bus 14 and the other 

processor when the interrupt mechanisms of the two t^cs of devices and elements of the System to form a single, 

processors which recognize and use diJOferent types, numbers cooperative system. It will be understood in the discussions 

and levels of interrupts. It will be recognized by those of herein that the term **processor" refas to any Processor 10 

ordinary skiU in the art that such interrupt interfacing may be or 12 connected from and having access to System Bus 14 

added to any or all of the processors in a multiprocessor-type 65 and that the interrupt interface mechanism operations and 

processor system notwithstanding their performance char- apparatus described herein may be used and operate between 

actcristics. any two or more ''processors'* in the system, or even for 
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interrupts of a **proccssor*' by itself, so that any processors 
of the system may be the '*first" and "second" processors 
described herein. 

As shown, the interrupt interfacing logic circuits include 
Pending Interrupt Registers 30, bidirectionally connected 
from the Processor 12's Bus Interface 18 and a set of Priority 
Interrupt Handlers (PIHs) 32<i through 32c» connected from 
outputs of Pending Interrupt Registers 30 and chained 
together with a final Interrupt Output (INT) to Miaopro- 
cessoT 20. PIHs 32 are also bidirectionally connected to 
Local Processor Bus 26. In the present iraplcmentation, 
described below as handling 16 levels of interrupts, PIHs 32 
arc comprised of Intel 8259 Monty Intarupt Handlers, 
whidi are described in the Intel Microsystem Components 
Handbook, Miaoprocessars, Volume 1, ISBN 1-555-12- 
001-6. 

Referring first to Pending Interrupt Registers 30, Pending 
Interrupt Registers 30 arc provided to receive and store 
interrupt requests received by a Processor 12 from another 
processor or element of the system through System Bus 14 
and the Processor 12*s Bus Interface 18. Pending Interrupt 
Registers 30 are essentially comprised of a bank of registers, 
the bank containing one register for each level of interrupt 
to be recognized and serviced by the Processor 12' s Micro- 
processor 20, 

Each register of Pending Interrupt Registers 30 is 
assigned to a corresponding interrupt level and is used to 
store any internet received which is of the corresponding 
level In the present implementation, 16 of the possible 
interrupt levels in the pcation of the system comprised of 
Central Processing Units 10, system Memory 16, System 
Bus 14 and the devices and peripheral devices designed for 
use with System Bus 14 have been selected to be handled 
and serviced by the Processors 12 so that Pending Interrupt 
Registers 30 correspondingly contain 16 registers. 

In other systems of in other implementations of the 
exemplary system described herein, more or fewer than 16 
levels of interrupt may be chosen for servicing by Processors 
12, with corresponding changes, which will be obvious to 
those of ordinary skill in the art, in the number of registers 
in Pending Interrupt Registers 30 and, as discussed further 
below, the number of interrupt levels handled by PIHs 32. 
Also, the interrupt logic unit disclosed in U.S. Pat No. 
4,839,800 invented by George J. Barlow and James W, 
Keeley entitled, "Data Processing System with a Fast Inter- 
rupt" which issued on Jun. 13, 1989 may be utilized This 
unit which utiJlizes two levels of interrupt request storage is 
similar to the type of interrupt units normally included in 
processors 10a and 10b of FIG. 1. 

As has been briefly described above and as is described in 
greater detail in the above referenced U.S. Pat. No. 3,997, 
896, any processor or device in the system which is designed 
for use with System Bus 14 may make an interrupt request 
of any other device or processor connected to System Bus 14 
by placing an interrupt request on System Bus 14. Each 
interrupt request is essentially comprised of a number or 
address, often referred to as a channel number, identifying 
the device or processor to receive the request, a numb^ of 
address identiifying the source of the request, and a code 
identifying the request as an interrupt request and the level 
of the interrupt 

The Bus Interface 18 of the intended recipient of the 
interrupt request recognizes the interrupt request and itself 
as the intended recipient and reads the request from System 
Bus 14. In the instance when the intended recipient is a 
Processor 12, the interrupt request is written into Pending 
Interrupt Registers 30 as described below. 
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As shown. Pending Interrupt Registers 30 are comprised 
of a bank of registers, with one register for each level of 
interrupt to be handled by Processors 12. Each register stores 
a Requestor Channel Number field 34 containing the chan- 

5 nel number identifying the source of an interrupt request, an 
Interrupt Busy Indicator field 36 containing a bit indicating 
whether the particular register presently contains a previ- 
ously received and pending interrupt request at the level 
assigned to the register which has not yet been processed and 
an Interrupt level field 38 containing a number representing 
the level of the corresponding interrupt 

In the present implementation, Channel Number field 34 
is a ten bit field and thus may identify up to 2^° individual 
processors or devices in the systcnL The Interrupt Level field 
38 is a four bit field and thus able to identify up to 16 
different interrupt levels. 

Upon receiving an interrupt request, the Bus Interface 18 
of a Processor 12 first determines the level of the received 
interrupt to determine whether the level of the received 
interrupt corresponds to an interrupt level selected to be 

20 handled by the Processor 12. If the interrupt level does not 
correspond to one of the selected interrupt levels, the Bus 
Interface 18 responds to the interrupt request by returning a 
Not Acknowledge (NAK) response on System Bus 14 to the 
source of the request 

23 If the intetrupt request corresponds to one of the selected 
interrupt levels. Bus Interface 18 reads the Interrupt Busy 
Indicator Field 36 of the register assigned to the level of the 
received interrupt If the Interrupt Busy Indicator Held 36 
bit indicates that there is no previously received pending 

30 interrupt at that level, the Bus Interface 18 writes the channel 
number of the interrupt requestor and the levd number of the 
request respectively, into the Channel Number field 34 and 
the Interrupt Level Field 38 of the corresponding register of 
Pending Interrupt Registers 30, and sends an Acknowledge 

35 (ACK) response to the requestor that the interrupt request 
has been received and accepted 

If the Interrupt Busy Indicator Field 36 bit indicates that 
there is a previously received interrupt request at that levd 
which is still pending, Bus Interface 18 and Pending Inter- 

40 nipt Registers 30 does not accept the new interrupt request 
at that level, and Bus interface 18 sends a Not Acknowledge 
(NAK) response to the requestor indicating that the interrupt 
is not accepted. The interrupt requestor may then resubmit 
the interrupt request at a later time. 

45 Lastly, a Level Decode Logic unit 40 is connected from 
the four bit ou^uts of the Interrupt Level Fields 38 of 
Pending Interrupt Registers 30. Level Decode Logic unit 40 
receives the four bit interrupt level codes into a correspond- 
ing 16 single bit outputs which are provided to the inputs of 

50 PIHs 32. Each single bit output line of Level Decode Logic 
40 corresponds to one of the assigned interrupt levels and an 
active level on any one or more of the output lines of Level 
Decode Logic unit 40 indicates that Pending Intarupt Reg- 
isters 30 presently contains a pending interrupt request at the 

55 corresponding interrupt level. 

The outputs of the Level Decode Logic unit 40 are 
connected to inputs of PIHs 32a through 32c according to 
the levels represented by the outputs of Level Decode Logic 
unit 40 and according to the rules described in Intel Micro- 

60 system Con^nents Handbook, Microprocessors, Volume 1, 
ISBN 1-555-12-001-6. As indicated, PIHs 32b and 32c are 
connected as slave units to PIH 32a which serves as the 
master priority interrupt handler unit The interrupt signal 
output of PIH 32a (INT) is connected to the interrupt input 

65 of Miaoprocessor 20. 

The presence of an interrupt request stored in any of 
Pending Interrupt Registers 30 results in an interrupt signal 
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input into Miaoprocessor 20. Miaoprocessor 20 responds 
to an interrupt signal input by interrogating PIHs 32 through 
Local E*rocessor Bus 26. The PIHs 32 respond by providing 
Microprocessor 20 with an indication of the particular 
highest priority PIH 32 input line having an active input 
from Level Decode Logic unit 40. From that information, 
Microprocessor 20 may read from the corresponding register 
in Pending Interrupt Registers 30, the Requestor Channel 
Number Field 34 of the register corresponding to the highest 
priority level interrupt then stored in Pending Interrupt 
Registers 30 and thus obtain the identity of the source of that 
interrupt request, and service the interrupt request accord- 
ingly. 

While Microprocessor 20 may, in some implementations 
of the system, read information directly from Pending Inter- 
rupt Registers 30, the present implementation of Pending 
Interrupt Registers 30 and Bus Interface 18 prefers to use an 
indirect access to Pending interrupt Registers 30 in order to 
take advantage of the existing design of the Bus Interface 18 
and to provide inherent serialization of operations, thereby 
avoiding possible race conditions. That is, Miaoprocessor 
20, upon receiving an indication of a pending interrupt 
stored in Pending Interrupt Registers 30 and the identity of 
the register containing the highest level interrupt, issues a 
read Pending Intenupt Register request to itself, that is, to 
the Miaoprocessor 20 of Processor 12 through Bus Inter- 
face 18 and onto System Bus 14. The Bus Interface 18 of the 
Processor 12 detects the read request issued to itself, and 
responds by reading the requested contents of Pending 
Intenupt Registers 30 onto System Bus 14. The Bus Inter- 
face 18 then reads the response place on System Bus 14 by 
itself and transfers the requested information from System 
Bus 14 to the Miaoprocessor 20. 
HG. 3 

Referring now to FIG. 3, there is shown a block diagram 
of a Processor 12 with the addition of ttie apparatus of the 
present invention contained in block 41 for reducing the 
reiteration of interrupt requests from one processor to 
another processor when an initial interrupt request by the 
requesting processor has been refused by the recipient 
processor. Again, it will be recognized by those of ordinary 
skill in the art that the interrupt retry logic shown and 
described herein may be added to any processor or proces- 
sors of the system and that, again, any processors of the 
system may be the 'Urst" and "second" processors described 
herein. In the following discussion, the term **first" proces- 
sor is used to indicate a processor which is making an 
interrupt request to another processor of the system, which 
is referred to in the following discussion as the "second" 
processor. 

As was previously described, a first processor of the 
system, such as a Processor 10 or 12 may make an interrupt 
request to a second processor of the system, such as a second 
Processor 10 or 12 through System Bus 14. In the example 
discussed herein, the Processor 12 may initiate the request 
for an interrupt and transmit this request to its associated Bus 
Interface 18 which then generates and place on System Bus 
14 the corresponding interrupt request. 

Also, as has been described, each interrupt request is 
essentially comprised of a number or address, often referred 
to as a channel number, identifying the device or processor 
to receive the request, a number or address identifying the 
source of the request, and a code identifying the request as 
an interrupt request and the level of the interrupt. 

The Bus Interface 18 of the second processor which is 
identified in the request as the recipient of the interrupt 
request detects and receives the interrupt request from 



14,200 

8 

System Bus 14. If the second processor accepts the interrupt 
request, the second processor acknowledges acceptance of 
the request by placing an "acknowledge" (ACK) response 
on System Bus 14, and this response is received from 

5 System Bus 14 by the first processor. If the second processor 
cannot accept the interrupt request, however, for example, 
when the second processor is servicing a previously received 
interrupt request of the same or higher priority level, the 
second processor refuses to accept the interrupt request and 
indicates this refusal by placing a "not acknowledge" (NAK) 
response on System Bus 14. ACK and NAK responses are 
generally similar in format to an intenupt request, but 
contain ACK and NAK codes in place of the field in an 
interrupt request which identifies the request as an interrupt 
request and the level of the interrupt 

15 In the event of a NAK response to an interrupt request, the 
first processor receives the NAK response from System 14 
and responds by storing an identification of the second 
processor in a field or regista in NAK Interrupt Register 42, 
and indicates to the second processor that the request has 

20 been refused at that time and must be resubmitted at a later 
time. 

As indicated in FIG. 3, the retry apparatus of block 41 
includes a plurality of NAK interrupt registers 42 and a level 
monitor logic unit 44. In the present implementation, the 

25 identification or address of the second processor stored in 
NAK Interrupt Register 42 is comprised of the channel 
number of the second processor or, as described further 
below, a portion of the channel number of the second 
processor along with the level code of the refused interrupt 

30 request 

Associated with NAK Interrupt Register 42 is Level 
Monitor Logic Unit 44 which is connected from System Bus 
14 and monitors "level changes" of the processors connected 
from System Bus 14, that is, indications appearing on 
35 System Bus 14 that a given processor, such as the second 
processor which was the intended recipient of an interrupt 
request, has changed its "level" with respect to servicing 
interrupts. 

Such "level changes" are issued during a bus cycle of 

40 operation which ensures the reliable switching between 
interrupt levels and the notification of such level changes to 
the other units of die system as described in U.S. Pat No. 
4,802,087 invented by James W. Keeley and George J. 
Barlow entitled, "Multiprocessor Level Change Syndironi- 

45 zation Apparatus" which issued on Jan. 31, 1989. 
Accordingly, the level monitor logic unit 44 includes com- 
parison logic circuits which take the form of the comparison 
circuits disclosed in referenced U.S. PaL No. 4,802,087, 
In this regard, as described above, Miaoprocessor 20 and 

50 Bus Interface 18 use an indirect access to Pending Interrupt 
Registers 30 in order to take advantage of the existing design 
of the Bus Interface 18 and to provide inherent serialization 
of operations, thereby avoiding possible race conditions. 
That is, Miaoprocessor 20, upon receiving an indication of 

55 a pending interrupt stored in Pending Interrupt Registers 30 
and the identity of the register containing the highest level 
interrupt, issues a read Pending Interrupt Regista request to 
itself, that is, to the Miaoprocessor 20 of Processor 12 
through Bus Interface 18 and onto System Bus 14. The Bus 

60 Interface 18 of the Processor 12 detects the read request 
issued to itself, and responds by reading the requested 
contents of Pending Interrupt Registers 30 onto System Bus 
14. The Bus Interface 18 reads the response place on System 
Bus 14 by itself and transfas the requested information from 

65 System Bus 14 to the Miaoprocessor 20. 

Bus Interfaces 18 of all processors connected from Sys- 
tem Bus 14 use a similar indirect access to the interrupt 
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handling mechanisms of the processors for the same reasons System Bus 14 from a second processor to itself which 

and the result is that each processor, when conqjleting the corresponds to a channel number stored in NAK Interrupt 

servicing of an intcmjpt, executes a scqucocc of one or more Registers 42 and has a level number ^ose priority is less 

commands or requests to itself pertaining to the completion than the level number associated with the stored channel 

of the servicing of the intemipt through its Bus Interface 18 5 number, 

and, accordingly, System Bus. Such commands and requests FIG. 4 

generally pertain, for example, to the clearing of certain The flow diagram of FIG, 4 illustrates the overall 

interrupt registers, sequence of operations for carrying out retry attempts by the 

As a result, however, the interrupt servicing operations of interrupt retry logic apparatus of the present. As mentioned 

a given processor results in oae or more commands or lO previously, the retry apparatus of the present invention may 

requests appearing on System Bus 14 at the conclusion of be used with various types of interrupt mechanisms, 

the processor's servicing of any interrupt request that had Therefore, for ease of explanation, it is assumed that the 

been pending in that processor. interrupt mechanism included within the first and second 

Level Monitor Logic unit 44 monitors the commands and processors contains minimal storage such as the type of 

addresses appearing on System Bus 14 for such interrupt 15 interrupt mechanism described in referenced U.S. PaL No, 

related commands and requests from a processor to itself 4,839,800. 

and compares the addresses, that is, the channel numbers Referring to FIG. 4, it is seen from block 400 that a first 

and level numbers of such commands and requests to the one of the processors of the multiprocessor system of FIG. 

channel numbers and level numbers stored in it associated 1 (i.e., first processor) attempts to intermpt a second one of 

NAK Interrupt Registers 42. The appearance of an end of 20 the processors in FIG. 1 (i.e., second processor). This 

interrupt completed related conmiand or request on System involves having the first processor place on system bus 14, 

Bus 14 by processor to itself which contains a channel an intermpt request containing the channel number of the 

number conesponding to a channel number stored in NAK second processor and the level number code. The second 

Interrupt Registers 42 of a second processor which has processor upon receipt of the interrupt request, compares the 

previously refused an interrupt request from its processor, 23 current level number stored within an internal level register 

that is, has previously responded with a NAK response, to tiie level number code contained in the interrupt request 

indicates to Level Monitor Logic unit 44 that the second of the interrupting first processor. 

processor may have completed servicing of the higjier level As indicated in block 402, when the second processor 

interrupt which caused the NAK response that the second current level is lower than the level contained in the interrupt 

processor may now be available to receive the previously 30 request, then the second processor sends an ACK response 

submitted interrupt request from the first processor, on system bus 14, accepts the request and begins processing 

As described herein, to ensure tiic success of a subsequent the second processor interrupt as indicated in block 404. If 

retry operation, the apparatus of the present invention addi- the second processor current level is the same or higher than 

tionally performs a level comparison operation for deter- the level of the first processor interrupt request, then the 

minin g priorities. More specifically, the retry apparatus 35 second processor sends an NAK response on system bus 14 

determines if the level number contained in the same end of as indicated in block 406. Additionally, as indicated in block 

interrupt completed related command designates a priority 406, the first processor in response to the NAK response, 

which is less than the priority by the level number stored in stores in an internal NAK intermpt register, such as one of 

the NAK Interrupt Registers 42 of the second processor the NAK interrupt registers 42, the refused interrupt request 

which previously refused that interrupt request. Retries are 40 More specifically, the first processor stores the channel 

only initiated when both the channel number and level number of the first processor which refused the interrupt 

number criteria are met request and the level number contained in the interrupt 

Level Monitor Logic unit 44 indicates the occurrence of request. Such level number designates the priority of the 
a interrupt complete command on System Bus 14 from a event which prompted the first processor attempted inter- 
second processor to itself which corresponds to a channel 45 nipt. The priority is assigned as a function of the type of the 
number stored in NAK Interrupt Registers 42 and specifies event In the case of an unsolicited event such as a power 
a lower priority level by generating a Repeat Interrupt failure.thelevel would be assigned the highest priority (Le., 
(RINT) signal to the interrupt handUng logic unit of its a zero value), 

associated processor. This is represented in FIG. 3 by the Next, as indicated by block 408, the first processor 

output RINT from Level Monitor Logic unit 44 to the PIHs 50 monitors system bus 14 via its level monitor logic unit 44 for 

32 of the Processor 12. the occurrence of an interrupt complete conomand indicating 

The processor responds to the RINT input from Level that the second processor has completed the processing of 

Monitor Logic unit 44 by determining the identity of the the interrupt and is initiating a "level change". When the first 

processor corresponding to the interrupt complete command processor completes its processing of an interrupt, it applies 

from NAK Interrupt Registers 42 and again generating the 55 die interrupt completed command to system bus 14 as 

corresponding previous interrupt request onto System Bus indicated by block 410. 

14 dirough Bus Interface 18. The previously described As shown in block 412, the first processor level monitor 

operations are performed once again. That is, the second logic unit 44 compares the channel number of the interrupt 

processor may accept and service the request, as indicated completed command to the channel number of the refused 

by the second processor placing an ACK response on 60 interrupt request previously stored in the NAK intrarupt 

System Bus 14, or the second processor may once again register to determine if they are the same. If, they are not the 

refuse to accept the request and places a NAK response on same, the first processor resumes monitoring the system bus 

System Bus 14. In this latter instance, the processor once 14 for further interrupt completed commands. As indicated 

again stores the channel number and level number of the in block 414, when the channel numbers arc the same, then 

refused interrupt request in NAK Interrupt Registers 42 and 65 the first processor compares the level number contained in 

Level Monitor Logic unit 44 again monitors System Bus 14 the intcnupt completed command with the level number of 

for the occurrence of a interrupt complete command on the refused interrupt request containing the chaimel number 
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of the second processor. If the level number of the intcmipt 
completed conimand is equal to or higher than the level 
number of the refused intarupt request, then the first pro- 
cessor resumes monitoring the system bus 14 for further 
interrupt completed commands. 

As indicated in FIG. 4, when the level number of the 
interrupt completed command is lower than the level num- 
ber of the refused interrupt request, then the first processor 
performs a retry of the original interrupt request (i.e,, takes 
the retry path). This results in the previously refused inter- 
rupt request being again placed on system bus 14. Since the 
refused interrupt request was determined to have a higher 
priority than the level to which the second processor 
switched, this ensures that the refused interrupt request will 
be most likely accepted by the second processor. 

The interrupt retry logic apparatus described above 
thereby reduces the number of interrupt retry attempts that 
a given processor need make when an interrupt request has 
been reftiscd by initiating the retry of a previously refused 
interrupt request to those points in the operation of the 
destination processor and under those processing conditions 
(i.e., priorities) when the destination processor is most 
probably capable of accepting an inteimpt request, that is, to 
those points when the destination processor has completed 
servicing of an interrupt and has switched to a level which 
has a priority lower than the priority of a previously refused 
interrupt request 

It should be noted that, in the present implementation, 
certain ranges of channel numbers are assigned to certain 
types of processors connected from System Bus 14, so that 
NAK Interrupt Registers 42 and Level Monitor Logic unit 
44 need not store and monitor all bits of the channel numbers 
appearing on System Bus 14. but only certain of those bits, 
thereby reducing the number of bits stored in NAK Interrupt 
Registers 42 for each channel number and the number of 
address lines monitored by Level Monitor Logic unit 44. 
Riither, it will be understood by those skilled in the art that 
the priorities of levels can be assigned in different ways and 
include designations of interrupt types or classes to the 
extent that this will expedite processing. Also, it will be 
appreciated by those skilled in the art that the retry apparatus 
of the present invention may be used with any type of 
processor notwithstanding its level of performance in order 
to minimize bus traffic. By including such apparatus in each 
processor, this will facilitate symmetrical operation. 

While the invention has been particularly shown an 
described with reference to a preferred embodiment of the 
method and apparatus thereof, it will be understood by those 
of ordinary sldll in the art that various changes in form, 
details and implementation may be made therein without 
departing from the spirit and scope of the invention as 
defined by the appended claims. 

What is claimed is: 

1. A multiprocessor system comprising a plurality of 
processors connected in conunon to a system bus for trans- 
ferring interrupt requests and interrupt completed com- 
mands between different ones of said processors during bus 
cycles of operation, each interrupt request including a first 
processor identification code designating an interrupting 
processor, a second processor identification code designat- 
ing which processor was atten^Jted to be interrupted by one 
of the plurality of processors and a level number speciifying 
the priority of the interrupt request, each intemipt completed 
conunand including the second processor identification 
code, a code indicating completion of processing an inter- 
rupt request by one of the plurality of processors and a level 
number specifying the level to which said second processor 
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switched, each processor including an intemipt mechanism 
having response means connected to said system bus for 
generating acknowledge and not acknowledge responses 
respectively signaling acceptance and refusal of each inter- 
5 rupt request a number of said plurality of processors includ- 
ing interrupt retiy apparatus, the interrupt retry apparatus 
comprising: 

a refused interrupt register means coupled to said system 
bus, said refused intemipt register means responsive to 

10 a not acknowledge response received firom a processor 
attempted to be interrupted in response to an interrupt 
request issued by an interrupting processor for storing 
the second processor identification code and level num- 
ber contained in the interrupt request; and, 

15 a level monitor unit connected to said system bus for 
detecting each occurrence of an interrupt completed 
command on the system bus, the level monitor unit 
being operatively connected to the refused interrupt 
register means and including comparison circuits for 

20 comparing the second processor identification code and 
level number in the interrupt completed command to 
the second processor identification code and level num- 
ber stored in the refused interrupt register means; the 
level monitor unit generating an interrupt retry output 

25 signal to the interrupting processOT only when the 
second processor identification code in die interrupt 
completed command identically matches the second 
processor identification code stored in the refused inter- 
rupt register means and the level number in the mter- 

30 rupt completed command has a predetermined value 
relative to the level number stored in the refused 
interrupt register means, the interrupting processor in 
response to the interrupt retry output signd reapplying 
the previously refused interrupt request to the system 

35 bus for acceptance by the processor previously 
attempted to be interrupted. 
2. The multiprocessor system of claim 1 wherein the 
predetermined value is less than the level number stored in 
tlie refused interrupt register means. 

40 3. The multiprocessor system of claim 2 wherein the value 
denotes that the refused interrupt request has a priority 
which is higher than the task being processed by the pro- 
cessor attempted to be interrupted. 

4. The multiprocessor system of claim 1 wherein the first 
45 and second processor identification codes correspond to 

previously assigned channel numbers. 

5. The multiprocessor system of claim 1 wherein said 
number of said plurality of processors including said inter- 
rupt retry apparatus are high performance processing units, 

50 each containing a high performance microprocessor. 

6. The multiprocessor system of claim 5 wherein the 
number of the plurality of processor includes all of the 
plurality of processors. 

7. The multiprocessor system of claim 1 wherein the 
55 interrupt request generated by the intemipting processor 

corresponds to any one of a predetermined number of 
different types of interrupt requests. 

8. The multiprocessor system of claim 7 wherein the 
number of different types of intemipt requests includes a self 

60 interrupt a solicited intemipt and an unsolicited interrupt 

9. TTie multiprocessor system of claim 8 wherein the self 
intemipt is generated by any one of the number of proces- 
sors for causing a level change to process a higher priority 
task. 

65 10. The multiprocessor system of claim 8 wherein the 
solicited interrupt is generated by a first one of the number 
of processors for notifying a second one of the number of 
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processors of having completed a task previously assigned 
by the second one of the number of processors. 

11. The multiprocessor system of daim 8 wherein the 
unsolicited interrupt is generated by a first one of the number 
of proccsson for notifying a second one of the number of 
processors of an occurrence of a system event, 

12. The multiprocessor system of claim 11 wherein the 
system event includes a power failure, environmental state 
change and a mechanical state change requiring servicing. 

13. A method for providing more effective reiterations of 
interrupt requests in a multiprocessor system comprising a 
plurality of processors tightly coupled to a system bus for 
transferring requests between processors during one or more 
bus cycles of operation, the requests including interrupt 
requests and interrupt completed commands, each interrupt 
request including a first processor identification code des- 
ignating an interrapting processor, a second processor iden- 
tification code designating which processor was attempted to 
t>e intonipted by one of the plurality of processors and a 
level number specifying the priority of the interrupt request 
each interrupt completed command including the second 
processor identification code, a code indicating completion 
of processing an interrupt request by one of the plurality of 
processors and a level number specifying the level to which 
said second processor switched, each processor including an 
inteaupt mechanism having response means connected to 
said system bus for generating acknowledge and not 
acknowledge responses respectively signaling acceptance 
and refusal of each interrupt request, the method corcqprising 
the steps of: 

adding retry apparatus to each processor of a number of 
said plurality of processors, the retry apparams includ- 
ing a refused interrupt register means and a level 
monitor unit coupled to the refused interrupt register 
means and the refused interrupt register means and 
level monitor unit, each being coupled to the system 
bus; 
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Storing the second processor identification code and level 
number of an interrupt request issued by each processor 
in the refused interrupt register means of the interrupt- 
ing processor in response to a not acknowledge 
response received from a processor attempted to be 
intermptcd by each interrupting processor; 

detecting each occurrence of an intcrmpt completed com- 
mand on the system bus by the level monitor unit of 
each interrupting processor; 

comparing the second processor identification code and 
level number in the interrupt completed command to 
the second processor identification code and level num- 
ber stored in the refused interrupt register means by the 
monitor level unit of each interrupting processor; 

generating an inteiiupt retry output signal by the monitor 
level unit of each interrupting processor to the inter- 
rupting processor only when the second processor 
identification code in the interrupt completed command 
identically matches the second processor identification 
code stored in the refused interrupt register means and 
the level mmiber in the interrupt coiiq)lctcd command 
has a predetermined value relative to the level number 
stored in the refused interrupt register means; and, 

reapplying the previously refused interrupt request to the 
system bus by the interrupting processor in response to 
the interrupt retry output signal for acceptance by the 
processor which was previously attempted to be inter- 
rupted by the interrupting processor. 

14. The method of claim 13 wherein the predetermined 
value is less than the level number stored in the reftised 
interrupt register means of the interrupting processor. 

15. The method of claim 13 wherein the step of adding 
retry apparatus to each processor of a nim:iber of the plurality 
of processors involves adding retry apparams to each pro- 
cessor of the plurality of processors. 
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